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Abstract 

We propose a multi input multi output(MIMO) system identification framework by interpreting the MIMO system in terms 
of a multirate synthesis filter bank. The proposed methodology is discussed in two steps: in the first step the MIMO system is 
interpreted as a synthesis filter bank and the second step is to convert the MIMO system into a SISO system “without any loss 
of information”, which re-structures the system identification problem into a SISO form. The system identification problem, in 
its new form, is identical to the problem of obtaining the signal matched synthesis filter bank (SMSFB) as proposed in Qj. Since 
we have developed fast algorithms to obtain the filter bank coefficients in m, for “the given data case” as well as “the given 
statistics case”, we can use these algorithm for the MIMO system identification as well. This framework can have an adaptive as 
well as block processing implementation. The algorithms, used here, involve only scalar computations, unlike the conventional 
MIMO system identification algorithms where one requires matrix computations. These order recursive algorithm can also be 
used to obtain approximate smaller order model for large order systems without using any model order reduction algorithm. The 
proposed identification framework can also be used for SISO LPTV system identification and also for a SIMO or MISO system. 
The efficacy of the proposed scheme is validated and its performance in the presence of measurement noise is illustrated using 
simulation results. 


Index Terms 

MIMO system identification, multirate filter bank, signal matched multirate synthesis filter bank, SIMO system identification, 

SISO LPTV system identification. Least squares, adaptive algorithm. 

I. Introduction 

This paper addresses the problem of MIMO system identification, which is required in various applications like human 
control behavior, modeling of unmanned aerial vehicles, robotic assemblies, chemical plants, power systems, multiuser channel 
estimation in communication systems, stock market analysis etc. m-ci. The objective of MIMO identification is to estimate 
the parameters of the system, which can either be described by a state space model 0, 121 or an FIR model cni, given the 
input and output signals or only with the information of the output signals. 

In this paper, given the observed input and output signals, we estimate the FIR model structure of a MIMO system 
using a variate form of signal matched synthesis filter bank(SMSFB) as defined IT]. An analogy is established between 
the MIMO system identification problem and the problem of estimating the SMSFB. Since we have developed fast algorithms 
to estimate the filter coefficients, in HI, we use the algorithm in this work for system identification. Most of the MIMO system 
identification methods, existing in the literature, suffer from two main drawbacks: 1) development of adaptive algorithms 
becomes cumbersome, and 2) parameter estimation involves matrix computations HD-IH. In contrast, the system identification 
algorithm used in this work involves only scalar computations and can be implemented in a block processing mode as well as 
in an adaptive manner. 

In control theory we come across various large scale complex systems which are approximated using smaller order models 
for computational efficiency or for design simplification. One of the existing approaches decompose the large order system 
into a number of decoupled sub-systems or small scale systems. Each sub-system is individually modelled and then using a 
coordinator the subsystems are adjusted such that the required response is achieved. Since the order recursive algorithm used 
in this paper have a lattice-like implementation, they can be used to approximate large order systems using a smaller order 
model in a fast and computationally efficient manner. Also, the decentralized systems can be naturally modelled using the 
proposed scheme. 

Control theory community have used theories and results from signal processing literature for example ARMA models. 
It has also been discussed by authors like Ljung Cl that a more extensive relationship between the two areas should be 
explored which will lead to promising results. This work is an example of a similar attempt. Here we use the results as well as 
algorithms existing in the multirate filter bank literature to propose computationally efficient system identification framework. 

This paper is organized as follows: in section II we present some preliminaries from the multirate filter bank theory and 
present a MIMO form of synthesis filter bank. This representation is, then, used to interpret a MIMO system in terms of a 


synthesis filter bank. In section III we convert a MIMO system into a SISO form and section IV discusses the MIMO system 
identification problem and re-structured the problem into a SISO form. The estimation problem, in this case, is identical to 
obtaining signal matched synthesis filter bank parameters, proposed in HI which can be exploited to obtain the required MIMO 
system. Since fast algorithms for SMSFB have already been developed in m, Ha for “given data” as well as “given statistics” 
cases, these algorithms can be used to compute the MIMO parameters in a computationally efficient manner. Thus, the MIMO 
parameters can be obtained if one realization of the process is available, also in real time and also for the cases where the 
statistics of the signal are known or can be estimated. The efficacy of the proposed algorithm is validated using simulation 
results in section V and conclusions are discussed in section VI. 

A. Notations 

In this paper we denote random variables by italic lowercase letters, vectors of random variable by italic, boldfaced, lowercase 
letters and matrices of random variables with italic capital letters. The norm of a vector x is denoted by || jc ||, which is the 
positive square-root of the inner-product of x with itself, where x belongs to a Hilbert space. 

II. MIMO SYSTEM AND MULTIRATE SYNTHESIS FILTER BANK 

In this section we interpret a MIMO system in terms of a multirate synthesis filter bank. First we briefly discuss the theory 
of synthesis filter bank and some of its results. 

A. Preliminaries 

In this section we briefly review some relevant results from the filter bank theory which are required for better understanding 
and appreciation of the results presented in this paper. An extensive treatment of the theory of multirate filter banks is available 
in ifT^ . 
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Fig. 1: M-channel multirate synthesis filter bank 

A set of digital filters represented by a multi input single output system, with each filter preceded by an upsampler, is called 
a synthesis filter bank, shown in Figure [T] An M-fold upsampler increases the sampling rate by a factor of M by appending 
M-1 zeros between every two samples of the input signal. 

Let us consider the i-th filter, of the M-band synthesis filter bank, denoted as Fi{z). Assuming the filter to be FIR and filter 
order to be multiple of M, without any loss of generality, we can write : 

N-l /(N/M-1) \ /(N/M-1) 

Fi(z) = ^ fi(n)z- = ^ fi(pM)z-MP + "“M ^ 

n=0 y p=0 J y p=0 

/(N/M-1) 

+ ... + z-(M-i) fi(pM-hM-l)z-’^P 

\ p=o 

= Fi,M-i(z“) + z“^Fi_M- 2 (z“) H-h 0 < i < M - 1. 

The M-components, written in the braces, are called the type-II polyphase components. The k-th component for the i-th 
filter can be written as: 


(N/M-1) 

Fi,k(z^)= fi(pM + M-l-k)z-“P, 

p=0 


0 < i < M - 1. 


( 1 ) 






















The synthesis filter bank can be represented using the polyphase components, as shown in Fig. |2] 
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Fig. 2; Synthesis Filters in terms of type-II polyphase components 
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Fig. 3: Noble Identity for Multirate systems 


The polyphase components of synthesis filters and upsamplers, given in Fig|2] can be re-arranged using the noble identity 
(given in Figl2l to obtain a computationally efficient structure for M-channel synthesis filter bank, as shown in Fig|4] 





Fig. 4: Polyphase decomposition of Synthesis filter bank 











































































From Figure |4] we can write the output y{n) as follows: 

{ yo{n) if n = iM, where i is an integer 
2/1 (n) if n = iM — 1, 

. 

yM-iiji) \f n = iM — M + 1 

From Figured the outputs, yi{n), can be written in the following form (using convolution): 


M-l N-1 


Xj{n — fc)fij(k), 0 < * < M — 1, 

(2) 

II 

O 

II 
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M-l N-1 


y^ y^ Xj{n — fc)fj(Mk -|- M — 1 — i), 0 < z < M — 1. 

(3) 

0 fc—0 



The above set of equations, for 0 < i < M — 1, can be written in a matrix form as follows: 
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— 1 ) 
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fo(0) fi(0) 
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(4) 


Equation (|4]i is a multi-input multi-output (MIMO) form of the synthesis hlter bank. It is pertinent to note that i-th channel 
output, i.e. yi{n), makes use of all the past inputs of all the input channels, i.e. Wi{k) for 0 < i < M — 1 and n — N + 1 < k < n. 

With these pre-requisites at our disposal we are now in a position to discuss the interpretation of a MIMO system in terms 
of multirate synthesis filter bank. 


B. Interpretation of MIMO system as multirate synthesis filter bank 

In this sub-section we represent a MIMO system in terms of a synthesis filter bank. This interpretation is used in the next 
section to propose the system identification algorithm. 
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Fig. 5: N-input M-output system 

A MIMO system with P inputs and M outputs. Fig. can be represented using an FIR model given as follows: 
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where, Yi{z) = ^i{z) = Xt{n)z ” and Hi(z) = X]n=o^ hi(n)z '"(without any loss of generality 

we can assume N’ to be a multiple of P). In time domain, the above equation can be written as; 
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Comparing (|4]i and (|6]l, we observe that the MIMO system, can be interpreted using a synthesis filter bank where the 
synthesis filter coefficients and the MIMO system parameters are related as: 

Q-l N'-l 

Hi(z) = E E + Q - 1 - i)zj+Q'^ (7) 

j=0 k=0 


where Q is the LCM(P,M) and N’=N. 

Using this analogy between the multirate filter bank and MIMO system the algorithms, results and tools available for filter 
banks can be easily used for MIMO systems and vice-verse. As mentioned in the abstract the next step in the proposed 
framework is to convert the MIMO system into a SISO form which will be latter used to re-define the MIMO system 
identification problem as a SISO form. 


III. SISO FORM OF A MIMO SYSTEM 

In this section we convert the MIMO system into a SISO system. In order to use the existing theories of SISO directly for 
MIMO systems researchers diagonalize the matrix H, resulting into M-SISO systems. However, this operation leads to loss 
of information which increases the error between the estimated system and the true system and these techniques can only 
be used when H is a square matrix. However, the methodology proposed here converts the MIMO system into a SISO form 
“without any loss of information”. The conversion can be achieved using the following steps: 

Step 1: Serializing the input signals using a commutator switch. 

We define a scalar process, z, which is a scalarized form of the vector process x{n), given as follows: 


z{Pn — i) = Xi{n), 

Therefore, equation® can be written as; 


0 < i < P - 1. 


N'/P-l 

yH = E H(i) 2 :(Pn-i) 

i=0 


( 8 ) 


(9) 


where 

z{Pn — 

i) = [ z{Pn — 

i) z(Pn — 1 — j) 

• • ziPn — P + 1 — i) 


ho(P * i) 

ho(P=i=i + l) 

■ ho(P*i-fP-l) 

H(i) = 

hi(P * i) 

hi(P=i=i-fl) 

hi(P*i + P-l) 


liM-i(P * i) 

hM-i(P * i + 1) • ■ 

• hM-i(P * i + P — 1) 


and 


yin) = [ yoin) yi{n) ■■■ yM-i{n) ] . 

Step 2: Seriahzing the outputs using a commutator switch. 

Using a commutator switch, the M-outputs of the single input multi output(SIMO) system, given in ®, are interleaved to 
give a single output, shown in Figlh] given as follows; 


w{Mn-i) =yi{n), 


0 <i < M -1. 


( 10 ) 














Therefore, we can write: 


where, 

w{Mn) = [ w{Mn) w{Mn — 1) 


N'/P-l 

w{Mn) = H(i) 2 ;(Pn —i) 

i=0 


w{Mn — M + 1) 


( 11 ) 



Fig. 6: SISO form of the MIMO system 


The MIMO system of Fig|5] can also be represented as Fig]?] 



Fig. 7: SISO interpretation of the MIMO system 


Equation (fTTli represents a single input single output system which is equivalent to the MIMO system represented by 
equation®. In the next section we first present the MIMO system identification problem, then using the equivalent SISO form, 
given by (HB, re-frame the problem. 


IV. MIMO SYSTEM IDENTIFICATION 

System identification refers to the operation of mathematical modeling of dynamic systems from the measured input and 
output data, as shown in Figure 



Fig. 8: MIMO system identification block diagram 




























( 12 ) 

(13) 


e(n) = d{n) - y{n) 

= d{n) — Hx{n), 

where the error vector is defined as: 

e(n) = [ eo(n) ei(n) eM-iin) ] and 

the measured output vector is given as: 
y{n)=[yo{n) yiin) yM-iiji) ] . 

The system identification problem considered in this work, for an N-input and M-output system (Figure [8]l, can be stated 
as: “given the P-inputs of the system, Xi{n) for 0 < i < P — 1, and the M-outputs, di{n) for 0 < i < M — 1, obtain the 
system parameters, hi{n), such that distance between the response of the estimated system, yi{n) and the true system, di{n), 
for 0 < i < M — 1, is minimized”. For dynamic systems, this is an adaptive identification problem. We are considering here 
a noiseless condition, however, the system can also be analyzed in the presence of noise. 

Using the equivalent SISO form of the MIMO system, (fTTI) . as obtained in the previous section, the above equation can be 
easily written as: 


e(n) = d{n) — H 2 ;(Pn) (14) 

Here, H can be obtained in the least squares sense, as given below: 

H = d{n)z'^{Mn) [;z(Mn);z'^(Mn)] (15) 

where, {Mn) denotes the transpose of vector z{Mn). Objective of the given system identification problem, therefore, is 
the solution of the above equation. However, the solution will involve matrix inversion and its complexity will increase as the 
number of inputs and outputs or the filter order increases. As mentioned in the signal processing literature, a recursive solution 
of equation ( fTSl) will not involve any matrix computations; thus yielding a computationally efficient and fast solution. 

It can be easily observed that the MIMO system identification problem, as represented by (fT4l) . is structurally similar to the 
estimation problem proposed in fll, for the signal matched synthesis filter bank(SMSFB). The concept of SMSFB, as proposed 
in im, can be easily re-worked to obtain the MIMO system parameters. 

In ID we have also developed a fast, order and time recursive least squares algorithm to compute the optimum filter 
parameters for the “given data case”. Moreover, for application where the statistics of the signal are available or can be 
computed, an order recursive Levinson-type algorithm has been developed in ifTSl . to obtain the optimum SMSFB coefficients 
in the mean square sense. Due to the similarity between the proposed MIMO system and SMSFB, as discussed above, the 
fast algorithms proposed in Q, Oil can be used to obtain the MIMO system parameters. The recursions, obtained in the 
algorithms, gives rise to lattice-like structures. Hence, we obtain a framework for MIMO system identification which involves 
only scalar computations and can be implemented in both block processing mode as well as adaptive mode. 

Remarks: 

1) In the proposed scheme we converted the given MIMO system into an equivalent SISO system and obtained the parameters 
using only scalar computations. It is easy to observe that the proposed framework can be used for a SIMO system as 
well as a MISO system identification problem. 

2) The “given data” as well as “given statistics” algorithms developed in ID and [] are order recursive algorithms and can 
be implemented using lattice-like structures. Therefore large order systems can be estimated using smaller order models 
without using any existing model reduction algorithms. 

3) Researchers have proposed that a SISO systems with linear periodically time varying property can be implemented with 
multiple filters and thus can be converted to MIMO systems Ini. Thus, the LPTV SISO system parameters can be 
obtained using the MIMO system identification proposed above. 

V. Simulations 

In this section, the efficacy of the MIMO system identification framework, as discussed in the previous section, is validated 
using simulation results. The following experiment is designed for this purpose. 

Experiment: For the purpose of simulation studies, we generate a signals using two AR processes, with poles at 
and respectively, and a 2 x 2 system, with filter order as 5. Now, given the input signals and the generated output 

signals the algorithm, proposed in this paper, is used to estimate the MIMO system parameters. And as mentioned earlier, 
the scheme proposed in this work can be analyzed in the presence of noise. For this purpose, we estimate the MIMO system 


parameters in the presence of measurement noise, which is white and independent to the input signals. The parameters computed 
for different SNR values are given in Table |I] 

TABLE I: Parameter values for different SNR 


SNR 

/io(0) 

fto(l) 

ho{2) 

ho (3) 

ho {4) 

actual parameters 

1.0183 

-1.9500 

2.2364 

-1.7274 

0.6192 

1 

1.0218 

-1.9626 

2.2733 

-1.7285 

0.6547 

0.1 

0.9988 

-1.9238 

2.2806 

-1.7740 

0.6843 

0.001 

0.9903 

-1.9183 

2.2690 

-1.7709 

0.6918 

SNR 

/ii(0) 

/ti(l) 

hi{2) 

hi{3) 

hi{4) 

actual parameters 

0.9872 

-2.3314 

3.4243 

-3.0962 

1.7222 

1 

0.9453 

-2.3106 

3.4250 

-3.1156 

1.7222 

0.1 

0.9062 

-2.3276 

3.4055 

-3.1027 

1.7338 

0.001 

1.0030 

-2.3336 

3.4322 

-3.0888 

1.7059 


VI. Conclusions 

In this work, a given MIMO system has been converted to a SISO system “without any loss of information”. This methodology 

can be used in various applications involving MIMO systems, for example in the design of MIMO control systems. We have 

also proposed that a MIMO system can be interpreted as the synthesis side of a filter bank, which helps to establish that the 

MIMO system identification problem is structurally identical to the parameter estimation problem of Signal Matched Synthesis 

Filter Bank H]. This analogy is exploited to obtain a computationally efficient solution for system identification. 
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